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300 



Receive a plurality of first coefficients and a plurality of second 
coefficients, a first quantization step size, a second quantization 
step size, and a quantization operation. 
310 

i 

Performing the quantization operation for a first coefficient of the 
plurality of first coefficients and a second coefficient of the plurality 
of second coefficients, the quantization operation based on the first 
quantization step size and the second quantization step size. 

320 

Determine whether the first coefficient is responsive based on the 

quantization operation. 
330 




Yes 



No 



^ 

Generate a coefficient responsiveness table comprising a 
distribution of responsiveness of the plurality of first 
coefficients for the first quantization step size. 

350 



FIG. 3 
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Set all possible coefficients 
as unresponsive 
402 



J 

Start from the first possible interval, i=1. 
between L. [right side of (G)] and U. 
[left side of (G)] 
404 



Start from the first possible 
coefficient value, i=1 . 
406 




Try next possible 
coefficient, i=i+1 
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FIG. 7 
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Receive an input quantization step size and a plurality of 
coefficients of a macroblock or a group of macroblocks 

810 

Determine a magnitude distribution of non-zero coefficients 
of the plurality of coefficients 
820 

Determine a plurality of candidate quantization step sizes 
based on a first table 
830 

Determine a quantization error for a range of quantization 
step sizes including the input quantization step size 

840 

Select a plurality of candidate quantization step sizes from 
the range of quantization step sizes wherein the plurality of 

candidate quantization step sizes produce a quantization 
error not greater than quantization error associated with the 
input quantization step size. 
850 

Determine the optimal quantization step size from the 
plurality of quantization step sizes based on a second table 
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